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Question 3 


Intent of Question 





The primary goals of this question were to assess students’ ability to (1) state and check appropriate 
conditions for inference in a study, (2) state the appropriate hypotheses for a statistical test, (3) identify 
and compute the appropriate test statistic, and (4) make a conclusion in the context of the problem. 
Solution 


Let A represent the cardiopump treatment, and let B represent the CPR treatment. 


Let Pa = proportion of patients who will survive at least one year if treated with the cardiopump. 


Let Dp = proportion of patients who will survive at least one year if treated with CPR. 
Part (a): 
Step 1: State the conditions for inference. 
The conditions required for a two-sample z test of equal proportions for an experiment are: 
1. Random assignment of treatments to subjects 
2. Sufficiently large sample sizes 
Step 2: Check the conditions. 

1. If we assume that the relevant characteristics of people who have heart attacks on even- 
numbered and odd-numbered days are comparable, randomly assigning one treatment to be 
given on even-numbered days and the other to be given on odd-numbered days is a reasonable 
approximation to randomly assigning the two treatments to the available subjects. 


2. The large sample condition is met because all of the following are at least 5 (or 10): 


NaPa = 37 25 or 10, na(1— pa) = 717 2 5 or 10 
NpPp = 15 250r10, np(1—- pg) = 7312 5 or 10 


Part (b): 
Step 1: State a correct pair of hypotheses. 


Ho:Pa — Pg =O (or Pa = Pg) 
Ha:Pa — Pp > 0 (or Da > Dp) 


Step 2: Identify a correct test by name or by formula. 


Two-sample z test for proportions 


OR 
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Question 3 (continued) 
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Step 3: Correct mechanics, including the value of the test statistic and p-value (or rejection region). 
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The p-value is 0.0011. 


Step 4: State a correct conclusion in the context of the problem, using the result of the 
statistical test. 


Because the p-value of 0.0011 is very small, that is, less than any reasonable significance level such 
as a = 0.01, or a = 0.05, we reject the null hypothesis. We have strong evidence to support the 
conclusion that the proportion of patients who survive when treated with the cardiopump is higher 
than the proportion of patients who survive when treated with CPR; that is, the survival rate is 
higher for patients treated with the cardiopump. (OR, If all of these patients had been assigned the 
cardiopump, we have strong evidence that the survival rate would be higher than if all of these 
patients had been assigned CPR.) 


Scoring 

This problem is scored in four sections. Section 1 consists of part (a). Section 2 consists of part (b), step 1. 
Section 3 consists of part (b), steps 2 and 3. Section 4 consists of part (b), step 4. Section 1 is scored as 
essentially correct (E), partially correct (P), or incorrect (I). Sections 2, 3, and 4 are each scored as 
essentially correct (E) or incorrect (I). 


Section 1 [part (a)] is scored as follows: 


Essentially correct (E) if the student correctly states and addresses randomization with reasonable 
justification AND correctly checks that the numbers of successes and failures are at least 5 or 10. 


Partially correct (P) if the student correctly states and checks only one condition, OR if the student 
states both conditions correctly but checks neither of them. 


Incorrect (I) otherwise. 
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Question 3 (continued) 
Section 2 [part (b), step 1] is scored as follows: 
Essentially correct (E) if the student states a correct pair of hypotheses. 


Note: The hypotheses may be stated using words or using transparent variable notation such as Dopp 


and Pop, even if the parameters are not defined. 
Incorrect (I) otherwise. 


Note: Hypotheses that clearly address sample proportions are incorrect. It must be clear that the 
hypotheses are not about the sample proportions. 


Section 3 [part (b), steps 2 and 3] is scored as follows: 
Essentially correct (EF) if the student identifies a correct test and includes correct mechanics. 


Note: The mechanics are considered correct if the student uses a pooled test procedure or an unpooled 
test procedure, as long as the correct value of z is calculated. 


Incorrect (I) otherwise. 


Note: If the student writes the formula for the unpooled version but gets the correct values for the test 
statistic and p-value for the pooled version, section 3 is scored as incorrect. 


Section 4 [part (b), step 4] is scored as follows: 
Essentially correct (E) if the student states a correct conclusion in the context of the problem. 


Note: A correct conclusion in context must explicitly state that the cardiopump survival rate is 
significantly higher than the CPR survival rate. 


Incorrect (I) otherwise. 


Notes: 

e If the p-value in section 3 is incorrect but the conclusion is consistent with the computed p-value, 
section 4 can be considered correct. 

e Insection 4if both an a and a p-value are given together, the linkage between the p-value and the 
conclusion is implied. If no a is given, the solution must be explicit about the linkage by giving a 
correct interpretation of the p-value or explaining how the conclusion follows from the p-value. 

e If, instead of a one-sided test, a student correctly performs a two-sided test (chi-square test for 
homogeneity of proportions or a two-sided z test for comparing two proportions), the final score 
drops automatically by 1 point. 
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Question 3 (continued) 


Each essentially correct (E) response counts as 1 point, and a partially correct (P) response in part (a) 
counts as % point. 


4 Complete Response 

3 Substantial Response 
2 Developing Response 
1 Minimal Response 


If a response is between two scores (for example, 112 points), use a holistic approach to determine whether 
to score up or down, depending on the strength of the response and communication. 
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3. A French study was conducted in the 1990s to compare the effectiveness of using an instrument called a 
cardiopump with the effectiveness of using traditional cardiopulmonary resuscitation (CPR) in saving lives of 
heart attack victims. Heart attack patients in participating cities were treated with either a cardiopump or CPR, 
depending on whether the individual’s heart attack occurred on an even-numbered or an odd-numbered day of 
the month. Before the start of the study, a coin was tossed to determine which treatment, a cardiopump or CPR, 
was given on the evei-numbered days. The other treatment was given on the odd-numbered days. In total, 

754 patients were treated with a cardiopump, and 37 survived at least one year; while 746 patients were treated 
with CPR, and 15 survived at least one year. 


(a) The conditions for inference are satisfied in the study. State the conditions and indicate how they are 
satisfied. 
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(b) Perform a statistical test to determine whether the survival rate for patients treated with a cardiopump is 
significantly higher than the survival rate for patients treated with CPR. 


Using ~the ole-Prodteas Hn, Py aes and P, Stetted in (0) 
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GO ON TO THE NEXT PAGE. 
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if you need more room for your work for part (b), use the space below. 


Step 3: Compute the test statistic os 


Z= os ~ Po A xX, + Xz 
SPaPoaha) where P= WAN, 
StS 
" 344746 , 240 f 
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—> PC2 > 3.066) = 0-00! 
Sep A. (Wrh a P-value this small, we have enough 
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GO ON TO THE NEXT PAGE. 
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cardiopump with the effectiveness of using traditional cardiopulmonary resuscitation (CPR) in saving lives of / 
heart attack victims. Heart attack patients in participating cities were treated with either a cardiopump or CPR, 
depending on whether the individual’s heart attack occurred on an even-numbered or an odd-numbered day of 
the month. Before the start of the study, a coin was tossed to determine which treatment, a cardiopump or CPR, 
was given on the even-numbered days. The other treatment was given on the odd-numbered days. In total, 

754 patients were treated with a catdiopump, and 37 survived at least one year; while 746 patients were treated 


with CPR, and 15 survived at least one year. 
R= 4.04404 Pr= p.or0\ot - 
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(b) Perform a statistical test to determine whether the survival rate for patients treated with a cardiopump is 
significantly higher than the survival rate for patients treated with CPR. 
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GO ON TO THE NEXT PAGE. 
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If you need more room for your work for part (b), use the space below. 
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GO ON TO THE NEXT PAGE. 
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3. A French study was conducted in the 1990s to compare the effectiveness of using an instrument called a io | 
cardiopump with the effectiveness of using traditional cardiopulmonary resuscitation (CPR) in saving lives of 
heart attack victims. Heart attack patients in participating cities were treated with either a cardiopump or CPR, 
depending on whether the individual's heart attack occurred on an even-numbered or an odd-numbered day of 
the month. Before the start of the study, a coin was tossed to determine which treatment, a cardiopump or CPR, 
was given on the even-numbered days. The other treatment was given on the odd-numbered days. In total, 
754 patients were treated with a cardiopump, and 37 survived at least one year; while 746 patients were treated 
with CPR, and 15 survived at least one year. , 


(a) The conditions for inference are satisfied in the study. State the conditions and indicate how they are 
satisfied. 
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(b) Perform a statistical test to determine whether the survival rate for patients treated with a cardiopump is 
significantly higher than the survival rate for patients treated with CPR. 
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GO ON TO THE NEXT PAGE. 
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If you need more room for your work for part (b), use the space below. 
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GO ON TO THE NEXT PAGE. 
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Question 3 


Sample: 3A 
Score: 4 


The only weak part of this response is the statement in part (a) that “both samples are taken independently 
and randomly.” For an experiment, the randomness required is that the treatments are randomly assigned 
to the available subjects. In this study the available subjects apparently were all people who had heart 
attacks in the participating cities during the time of the study, so the two samples are not independent 
and are not random samples from a larger population to which the conclusion would apply. Nevertheless, 
the student's following statement (“[r]andomization process is used, such as using a toss to decide 
treatment assignation”) conveys the right idea—that the coin flip should be equivalent to randomly 
assigning available subjects to the two treatments—so section 1 [part (a)] was scored as essentially 
correct. The hypotheses, test identification, mechanics, and conclusion steps in part (b) are well done, 
with sufficient work shown. Thus section 2 [part (b), step 1], section 3 [part (b), steps 2 and 3], and 

section 4 [part (b), step 4] were each scored as essentially correct. This complete response successfully and 
concisely accomplishes all four parts of a test of significance of the difference of two proportions and 
received a score of 4. 


Sample: 3B 
Score: 3 


This response is very successful in stating and checking the conditions in part (a). It also very competently 
states the hypotheses and conclusion that are most appropriate for this experiment in part (b). The 
randomization, hypotheses, and conclusion are said to apply only to the available subjects: if all patients 
had been assigned the cardiopump, the survival rate would be higher than if all patients had been 
assigned CPR. Thus section 1 was scored as essentially correct, as were sections 2 and 4. However, the 
mechanics step in section 3 was scored as incorrect. The formula given for the standard error does not 
include a pooled estimate of the common proportion, yet the z-statistic of “3.066,” presumably from the 
calculator, is the value obtained with a pooled estimate. Because sections 1, 2, and 4 were essentially 
correct, this substantial response received a score of 3. 


Sample: 3C 
Score: 2 


Because there is no mention of random assignment of treatments to subjects, but the check that the 
sample sizes are sufficient is acceptable, section 1 of this response was scored as partially correct. In 

part (b) the hypotheses appear to be about the difference in the proportion of patients who “survived” (past 
tense) between the two treatments. Consequently, section 2—the hypotheses step—was scored as 
incorrect. Sections 3 and 4—the mechanics and conclusion steps—were scored as essentially correct, 
although the final sentence is not clear. Because section 1 was partially correct, section 2 was incorrect, 
section 3 was essentially correct, and section 4 was essentially correct, this developing response received 
a score of 2. 
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